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Abstract. Conditionspectrum measures the computational stability of solv- 
ing a linear system. In this paper, ten theorems involving e-conditionspectrum 
are presented. All these theorems generalize a well known eigenvalue theorem 
and simultaneously compare with an appropriate pseudospectra theorem. Our 
organizing principle is that each conditionspectrum result precisely reduces to 
the corresponding eigenvalue theorem when e = 0. The format of each condi- 
tionspectrum result is similar to the pseudospectrum result for easy compar- 
ison. Each condition spectrum is formatted similar to pseudospectrum result 
for the easy comparison. 



The idea of condition spectrum was conceived while trying to realize pseudospec- 
tra as a special case of generalized spectra defined by Ransford in [5] . The axiomatic 
approach of his study compelled S.H.Kulkarni and the author in [2 , to modify 
slightly the underlying basic set so as to satisfy the axioms of Ransford. The newly 
defined condition spectrum in itself has interesting properties which were published 
in [21 [3]. In this article, its connection with the usual spectrum (eigenvalue) and 
pseudospectrum are discussed. Only those results on condition spectrum that have 
exemplary analogy with the other two spectra are chosen for presentation. 

Each theorem is arranged in triplet, labeled with the same number followed 
by relevant suffix. The first part is a result about the usual spectrum. The sec- 
ond part is a generalization of the first result using pseudospectrum, while the 
third part, the main contribution of this article, generalizes the first part result 
in terms of condition spectrum. For example, Theorem 1, le and ler, denotes the 
first theorem for usual spectrum, pseudospectrum and condition spectrum respec- 
tively. This arrangement makes the reader to compare and comprehend the results 
conveniently. Note that all the e and a theorems reduces to corresponding usual 
spectrum (eigenvalue) theorem, as e tends to zero. This arrangement of results are 
essentially following the article [T]. 



1. Introduction 

Let A be a N x N matrix with complex entries., ie A 6 Mjv(C). Let A and z 
denote complex numbers. 

Definition 1.1 (Condition spectrum). Let < e < 1. The e-condition spectrum 
of a matrix A is defined as 

a e (A) := I z e C : z - A is not invertible or || (z - A)^ 1 1| \\z - A\\ > -> . 
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Equivalently we can write it as a e (A) := {z e C : ||(z — A) 1 || \\z — A\\ > j-} 
with the convention that || (z — A)~ x || \\z — A\\ =00 when z — A is not invertiblc. 
The name of the spectrum and the range of e are justified from the definition, as 
it related to the condition number of A — z. 

For the sake of completeness we give the definition of pseudospectrum which 
is used to understand the behavior of non-normal matrices. The properties and 
applications are available in [5]. 

Definition 1.2 (Pseudospectrum). Let e > 0. The e-pseudospectrum of a matrix 
A is defined as 

A e (A) := {z € C : z - A is not invertible or \\(z - ^4) 1 1 1 > e} . 

Consider solving the system of equations Ax — Xx = b. The eigenvalues of A says 
the points in the complex plane at which A — A is not invertible and hence deals 
about the uniqueness of the solution. The pseudospectra of A conveys the points 
at which ||(A — A) -1 ]] becomes very large and hence deals with the computational 
aspects of the solution. The condition spectra captures the points in the complex 
plane at which the condition number \\A — A|| || (A — A) -1 1| becomes huge and hence 
elaborates the computational stability aspect of deriving the solution. 

It is proved in [2] that the condition spectrum is a non empty, compact, perfect 
set (no isolated points) and always contains the usual spectrum. In [3], a sufficient 
condition for a function to be almost multiplicative is given using conditionspec- 
trum. Here we list two results which will be referred often subsequently. The 
interested reader can refer [5j for the proofs. 

Lemma 1.3. For every < e < 1, <j(A) C a e (A). 

Lemma 1.4. For every < e < 1, cr e (A) is compact. 

The above results are proved in a general setting, when A is a Banach algebra 
element. On the contrast, the proof of the following equivalent conditions mainly 
relies on finite dimensionality. 

Theorem 1.5. The following definitions are equivalent. 

(1) a e {A) = {z e C : \\ (z - ^l)" 1 1| \\z - A\\ > e" 1 } 

(2) B = {zeC: 3u G C" with \\u\\ = 1 s.t \\(z - A)u\\ < e \\{z - A)\\} 

(3) C = {z e C : z € a{A + E)for some E with \\E\\ <e\\(z-A)\\} 

Proof. First observe that eigenvalues of A are there in all the three sets. For that, 
suppose z is an eigenvalue then 

• z € c £ (j4) by the convention \\z — A\\ ||(z — ^4) _1 || = 00. 

• z € B by taking u as any normalized eigenvector corresponding to the 
eigenvalue z. 

• z € C by taking E = 0. 

As eigenvalues belongs to all sets, it is enough to prove, the elements of one set 
(excluding eigenvalues) belongs to other sets. The following three implications 
together establish the proof of the theorem. 

(1 =>• 2) : Suppose z <E <r e {A) and z £ a (A) then ||z-j4|| ||(z-^4) _1 || > e _1 . 
Since unit sphere in finite dimensional space is compact, there exists an element 
u e C™ such that ||u|| = 1 and 

IKz-yl)- 1 ^!! = \\(z - A)~ 1 \\ 



EIGENVALUES, PSEUDOSPECTRA AND CONDITIONSPECTRA 



3 



Define 

u = (z — A) u, 

so that I lull = (z — A) -1 and (z — A)u — u. Let u = 77^77, then 

\H\ 

II, 11(^-^)^11 INI 1 . || „|| 

II(Z ' AH= jjsjj = M = ||(z-A)-i|| ^ e ll*-4l 

and hence z £ B. 

(2 =>■ 3) : Suppose z e B then there exists u € C" with ||u|| = 1 such that 

\\{z-A)u\\ <e\\{z-A)\\. 

Let v £ C™ be a unit vector satisfying (A — z)u = ev with e < e \\z — A\\. Let w be 
a vector with \\w\\ = 1 such that w*u = 1. With such a u) we can write 

zu = Au — ivw*u — (A — evw*)u 

which means that z £ cr(A + E) for E — —ivw* satisfying \\E\\ < e. 

(3 1) : Suppose z £ <r(A + E) for some E with||£;| <s\\(z- A)\\. Then there 
exists a unit vector v £ <C such that (A + E)v = zv. By rearranging and inverting 

zv — Av + Ev 

(z - A)v = Ev 

v=(z- A)~ l Ev 

and thus we have 

l = \\v\\ = \\(z-A)- 1 Ev\\ < IKz-^HllEH < \\(z-A)- l \\e\\(z-A)\\, 
implies that ||(z — ^4) _1 || \\{z — A)\\ > e" 1 and hence z £ a e (A). □ 

2. Results 

Ten results that are generalizing the theorems of usual spectrum are given. Only 
proofs of conditionspectrum results, that is theorems with the suffix a, are given. 
Proofs of the usual spectrum are available in any standard book on linear algebra 
and the proofs of pseudospectra results are available in [T] . Note that each condition 
spectrum result tends to the corresponding eigenvalue theorem in the limiting case 
as e tends to 0. 

Theorem 1. A is singular £ cr(A). 

Theorem le. H^ -1 )! > £_1 £ A e (A) when A is not singular. 
Theorem la. \\A\\ ||^4 _1 || > £ a E (A) when A is not singular. 

Proof. Follows from definition of condition spectrum. □ 
The bounds for the spectral radius of the condition spectrum. 

Theorem 2. A £ a (A) |A| < \\A\\ 
Theorem le. A £ A e (A) =>■ |A| < || A\\ + e 

Theorem 2a. A £ a e (A) |A| < j—^ \\A\\ 
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Proof. Let A G a e {A). If |A| < \\A\\, then clearly |A| < ^-t£ ||A||. 

Suppose |A| > ||A|| then A — A is invertible and ||(A — ^4) _1 || < y^j jj^jj"' Using 

this in the definition of condition spectrum we have 

1 < elkA-aT 1 !! ||A - a\\ <e 



-ilhu JA| + ||A|| 



|A|-||A||- 
On simplification, 

|A|<i^|L4||. □ 

Theorem 3. A has N distinct eigenvalues => A is diagonalizable. 
Theorem 3e. A £ (A) has N distinct components A is diagonalizable. 
Theorem 3c & £ (A) has N distinct components => A is diagonalizable. 
Proof. Refer [2] for a proof. □ 

There are two components in condition number. One is norm of the matrix and 
the other is norm of its inverse. The following inequality estimates the norm of the 
inverse. 

Lemma 2.1. Let A be a Banach algebra. Let a,b G A. If a is invertible in A and 
b is not invertible, then 

(2-1) _^<|| a _ 6 ||. 

Il a II 

The next result gives a relation between the norm of the resolvent with condition 
spectrum. 

Theorem 4. ||(z-^4) _1 ||> ' 



Theorem 4e. (z - Ay 1 > 



Theorem 4<t. II (z - Ay 1 II > 



d(z,a(A)) 
1 

d(z, A e (A)) +e 
1 

d(z,a E (A)) + T^\\M 



Proof. If z £ a e (A) then the inequality is immediate from the definition of condition 
spectrum. So assume z ^ o~(A) that is z — A is invertible. Since <J e (A) is compact, 
we can choose A G cr £ (A) such that |A — z\ — d(z,a e (A)). As A G cr e (A) there 
exist a matrix E such that \\E\\ < e ||A — A\\ such that A G a(A + E). This implies 
A — A — E is not invertible and so z — (A + E + z — A) also. Now letting a = z — A 
and b = z — (A + E + z — X) in Lemma 12.11 we get 

OT^TaPI <\\z-A-[z- (A + E + z- X)]\\ = \\E + z-X\\ 

< |*-A| + p5|| 

< d(z, a £ (A)) + e \\X - A\\ < d(z, a e {A)) + \\A\\ 
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Hence it establishes the required inequality. □ 

The spectrum is invariant under similarity transformation. Similarly the condi- 
tion spectrum is also preserved under certain similarity transformation. This result 
will be helpful in the computational designing of conditionspectra. We use the 
standard notation n(S) — \\S\\ \\S^ 1 \\ to denote the condition number of a matrix 
S. 

Theorem 5. A = SBS- 1 =*> a(A) = a(B) 
Theorem 5e. A = SBS- 1 A E (A) C A K(s)e (B) 

Theorem 5a. A = SBS- 1 => a £ {A) C a K ^ s y e (B) whenever n(S) 2 e < 1. 
Proof. Let z £ & £ (A) then 

-<\\z-A\\ Wiz-A)- 1 ]] = \\zSS- 1 - SBS' 1 ]] \\izSS- 1 - SBS- 1 )- 1 ]] 

^(llfiriiiis-^D'ii^-BiiiKz-s)- 1 !! 

< k{S) 2 \\z-B\\ \\iz-B)- 1 ]] a 

From this it is clear that similarity transformation through a matrix S with 
condition number 1, that is k(S) = 1, preserves the condition spectrum, (since 
a s(A) C a £ {B) and cr £ (B) C a s (A)). In particular, similarity transformation 
through orthogonal and unitary matrices preserves the condition spectrum. 

The next two results calculate the transient behavior of A from the knowledge of 
its condition spectrum. But they do not completely describe the nature, as pointed 
out in [6] . If one of the eigenvalue is bigger than 1 then the powers of A blows up 
to infinity. Condition spectrum also behaves in the same way. 

Theorem 6. 

max |A| > 1 sup ||A fc || = oo 

\ecr(A) k>0 

Theorem 6e. 

max |A| > 1 + Me => sup \\A k \\ > M 

Theorem 6a. 

1 + M 2 e 1 

max |A| > =4- sup \\A k \\ > M whenever M < - 

\e& E (A) I- Me fc > " " e 

Proof. It is easy to establish the result for two simple and extreme cases. First one 
is the case when M < 1. Here the result is immediate as ||j4°|| = 1- The other case 
is when there is an eigenvalue A of A with |A| > 1. Since A is an eigenvalue of A, X k 
is an eigenvalue of A k for all k g N and hence |A fe | < ||^4 fe || for all k. This implies 
sup fc>0 ||^4 fe || is infinity and hence the result. 

Now, excluding the above mentioned simple cases, we prove the theorem by 
negation. That is, assume M > 1 and no eigenvalue of A has absolute value greater 
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than 1. Suppose sup fc>0 ||A fe || < M, we will prove 

1 + M 2 e 

max < -, Tl~- 

\e<y E (A) 1 — Me 

Let A G a £ (A)\a(A). It is clear that if |A| < M then |A| < when ever M < \. 

When |A| > M, as A — A is invertible, we get 



\n zn-HI 1 ll^ll M 1 M 



1 

1 

V 1- |A|7 



M 



|A|-1 



.1 M 

Combining the above inequality with A G o>(A) gives — — < - — . . On 

6 ; a e||A- A|| ~ |A| - 1 

1 + M 2 e 1 
simplification, |A| < — — provided M < —. As A is arbitrary in a e (A) \ a(A) 

IM <r 1 + 
max A < , 

xea e (A) 1 1 ~ 1 - Me 
and that proves the claim. □ 

Theorem 7. A G <j(A) => ||A fe || > |A| fc /or all k 

fe-i 

1 - fce/pjj 



Theorem 7e. A G A e (A) ||A fc || > |A| fe - ^ ^ /or all k such that 
ke < \\A\\ 



ks \\A\ 

Theorem 7a. A e <t e (A) ||A fc || > |A| - ' - for all k such that 

(2k + l)e < 1 w/iere s = ||A|| 

1 — s 

Proof. Let A G cr £ (A). Pick < e||A-A|| such that A G a(A + E). Then 
|A fc | < ||(A + £') fe || which implies 

||A|| fc >|A| fc -Q) WAf-'WEW-^j P|| fc - 2 ||i?|| 2 -... 

> |A|* - k \\A\\" e]\X- A|| (l + + (^^) 2 + • • ■ ) • 

Provided fee ||A — A|| < ||A||, the series in this last equation converges, giving 

„ ,„fc fc||A|| fc_1 e||A- A|| fcsHAf^ 1 

||A|| fc >|A| A - " 1 . „ ' „ 11 >|A| A 11 



fc-i 



-, fcellA— All — I I -, fcs 

with s = y— — l|A||. Also note that (2k + l)e < 1 implies fee ||A - A|| < ||A|| by 
Theorem [2Jt. " □ 

The following result is analogous with Gerschgorin's theorem which locate the 
spectrum in the complex plane. In our case it locates the condition spectrum. We 
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denote the closed ball with center a and radius r by D(a, r). Let dj be the diagonal 
entry ajj of A and r 3 = E^i&i^ Kl- 

Theorem 8. ct(A) C |J^ 1 D(dj,rj) 

Theorem 8e. A £ (A) C |J^ 1 D(dj,rj + VNe) 

Theorem 8a. <r £ (A) C Uf =1 D (dj.r,- + V^V^ ||A|| 

Proof. By equivalent definition, A e ct £ (j4) if and only if A e <r(^4 + 2?) for some _E 
with ||.E|| < e || A — Applying the Greschgorin's theorem to A + E we get 



A e |J D ( dj + ejj.rj + M 

where are the entries of E. The above balls are contained in balls centered at 
dj with radius rj + Efcli \ e jk\- Now note that, with Ej as a matrix whose jth row 
is same as jth row of J5 and remaining rows are zero, 

N 

E M ^ Halloo ^ v 7 ^) H^ll 2 < v^||£|| 2 . 
*;=i 

We know that ||£7|| < e||A- A|| < £ (f±§ ||A|| + ||A||) < ^ ||A||. Hence using this 
information and the previous inequality we get 



A e\jD(d jirj :+Vn^- £ \\A\. 

Since A is arbitrary, this proves the required result. 

<r e (A) C\JD (dj, rj + ViV^ \\A\\) a 

Numerical range is equally explored like spectrum because of its computabil- 
ity. The next result connects numerical range and condition spectrum. We write 
conv(S) for the convex hull in C of a set S C C. The notion S \ £-border means 
the set of points zeC such that D(z,e) C S 

Theorem 9. W(A) D conu(cr(A)) 

Theorem 9e. W{A) D cora;(A e (A)) \ e - &order 

Theorem 9<r. D conw(cr e (A)) \ £i - border, here e\ = \\A\\. 

Proof. We first prove the following claim: 

conv(a e (a)) C W(T) + B (o, ^ ||T||) . 



8 



SUKU 



If A G C and d(X, W(A)) > 0, then A - A is invertible and (see Theorem 6.2- A], 
also Ex. 27.7, p501,g|) 

||(A7- A)- 1 !! < 1 



d{\W{A)Y 



Let A G <j s {A). If A G W(A), then the conclusion is obvious. Next, if A G o~ £ (A) \ 

1 



W(A), then 

d(A,W(A)) < 



ll(A-A)-i|| 



< £ ||(A-A)|| < £ (|A| 

'1 + 6 



141) 



< £ 



1 



Thus 



ct £ (j4) C W(A)+B[0, 



\A\\ 



2e 



All = 



2e 



HI- 



141 



Since the right hand side is a convex set we have established the claim. 
conv(a £ (a)) and W(A) are convex sets we get the required result. 



As 
□ 



Spectral mapping theorem describes the behavior of the spectrum under cer- 
tain transformation. The following result belongs to that kind. It gives a precise 
information about the condition spectrum under linear transformation. 



Theorem 10. 
Theorem lOe. 
Theorem 10cr. 



a(a + PA) = a + fia(A) for all a, /3 G C 
A eW (a + 0A) =a + pA £ (A) for all a, /3 G C 
o e (a + PA) = a + pa e (A) for all a, p G C 



Proof. For the case p = follows from the fact a £ (a) = {a}. Consider p ^ 0, 



{a + pA)\\ \\{z- (a + pA))- 1 ] 



(z — a) 



PA 



(z — a) 



pA 



(z — a) 



A 



(z — a) 



-A 



□ 



The above results analyze the similarity between condition spectra and pseu- 
dospectra. The results in [21 13] presents basic properties of conditionspectra and its 
connection with other areas. All these results together demonstrates the potential 
of condition spectrum and the need for further investigation. The computational 
aspect of this spectrum is yet to be investigated. There are other results in [1] for 
which, at present, the generalizations in conditionspectrum are unknown. 
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